Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Runtime][Disco] Restore checks for hangup of disco pipe #16997

Merged

Conversation

Lunderberg
Copy link
Contributor

@Lunderberg Lunderberg commented May 14, 2024

This resolves a conflict between two recent changes. In #16989, reads of size zero are used to identify hangups in ProcessSession. In #16992, reads of size zero are treated as an error to avoid infinite loops while waiting for data to be ready.

For a long-term resolution, the dmlc::Stream interface will need to be updated, so that the Write method returns the number of bytes written, just as the Read method currently does. This will allow the calling scope to verify the number of bytes received.

This resolves a conflict between two recent changes.  In
apache#16989, reads of size zero are used
to identify hangups in `ProcessSession`.  In
apache#16992, reads of size zero are
treated as an error to avoid infinite loops while waiting for data to
be ready.

For a long-term resolution, the `dmlc::Stream` interface will need to
be updated, so that the `Write` method returns the number of bytes
written, just as the `Read` method currently does.  This will allow
the calling scope to verify the number of bytes received.
@Lunderberg Lunderberg merged commit f044eef into apache:main May 15, 2024
19 of 20 checks passed
@Lunderberg Lunderberg deleted the disco_restore_check_for_hangup_on_pipe branch May 15, 2024 13:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants